Minimax optimal conditional density estimation under total variation smoothness
نویسندگان
چکیده
This paper studies the minimax rate of nonparametric conditional density estimation under a weighted absolute value loss function in multivariate setting. We first demonstrate that is impossible if one only requires pX|Z smooth x for all values z. motivates us to consider sub-class absolutely continuous distributions, restricting pX|Z(x|z) not be Hölder x, but also total variation propose corresponding kernel-based estimator and prove it achieves rate. give some simple examples densities satisfying our assumptions which imply results are vacuous. Finally, we an optimal adaptively, i.e., without need know smoothness parameter advance. Crucially, both estimators (the adaptive non-adaptive ones) impose no on marginal pZ, obtained as ratio between two kernel smoothing may sound like go approach this problem.
منابع مشابه
Density Estimation by Total Variation Regularization
L1 penalties have proven to be an attractive regularization device for nonparametric regression, image reconstruction, and model selection. For function estimation, L1 penalties, interpreted as roughness of the candidate function measured by their total variation, are known to be capable of capturing sharp changes in the target function while still maintaining a general smoothing objective. We ...
متن کاملBottleneck Conditional Density Estimation
We propose a neural network framework for high-dimensional conditional density estimation. The Bottleneck Conditional Density Estimator (BCDE) is a variant of the conditional variational autoencoder (CVAE) that employs layer(s) of stochastic variables as the bottleneck between the input x and target y, where both are highdimensional. The key to effectively train BCDEs is the hybrid blending of ...
متن کاملCopula Density Estimation by Total Variation Penalized Likelihood
A copula density is the joint probability density function (PDF) of a random vector with uniform marginals. An approach to bivariate copula density estimation is introduced that is based on a maximum penalized likelihood estimation (MPLE) with a total variation (TV) penalty term. The marginal unity and symmetry constraints for copula density are enforced by linear equality constraints. The TV-M...
متن کاملOn minimax density estimation on R
the problem of density estimation on R from an independent sample X1, ...XN with common density f is concerned. The behavior of the minimax Lp-risk, 1 ≤ p ≤ ∞, is studied when f belongs to a Hölder class of regularity s on the real line. The lower bound for the minimax risk is provided. We show that the linear estimator is not efficient in this setting and construct a wavelet adaptive estimator...
متن کاملExact Minimax Predictive Density Estimation and MDL
The problems of predictive density estimation with Kullback-Leibler loss, optimal universal data compression for MDL model selection, and the choice of priors for Bayes factors in model selection are interrelated. Research in recent years has identified procedures which are minimax for risk in predictive density estimation and for redundancy in universal data compression. Here, after reviewing ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2022
ISSN: ['1935-7524']
DOI: https://doi.org/10.1214/22-ejs2037